The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
litellm	Ready	Preview, Comment	Feb 7, 2026 8:14pm

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

Greptile Overview

Greptile Summary

This PR correctly fixes a regression from PR #19818/#20205 where the Router was being created unconditionally, even when there were no models and no search_tools to route. The fix adds back the conditional check if len(_model_list) > 0 or search_tools: before Router creation.

Changes:

• Wraps litellm.Router() instantiation in a conditional that checks for either models or search_tools
• Preserves the ability to create Router with search_tools only (the goal of PR fix: search tools not found when using per-request routers #19818)
• Prevents unnecessary Router creation when both model_list and search_tools are empty

Impact:

• Fixes failing test test_add_and_delete_deployments[0-None]
• Aligns with custom rule 0c2a17ad-5f29-423f-a48b-371852ac4169 about avoiding unnecessary Router object creation
• No breaking changes; all existing functionality preserved

Confidence Score: 5/5

• This PR is safe to merge with minimal risk
• The fix is a simple, well-tested conditional check that addresses a clear regression. The logic correctly handles all four scenarios (models only, search_tools only, both, neither) as documented in the PR description. All six test cases pass, including the previously failing test. The change is minimal, focused, and aligns with the custom rule about avoiding unnecessary Router object creation.
• No files require special attention

Sequence Diagram

sequenceDiagram
    participant Client as Client Request
    participant PS as ProxyServer
    participant PC as ProxyConfig
    participant R as Router
    participant DB as Database

    Client->>PS: Add/Delete Deployments
    PS->>PC: _update_llm_router(new_models)
    PC->>DB: get_config()
    DB-->>PC: config_data
    PC->>PC: parse_search_tools(config_data)
    PC->>PC: decrypt_model_list_from_db(models_list)
    
    alt llm_router is None AND master_key exists
        alt len(_model_list) > 0 OR search_tools exists
            PC->>R: Create litellm.Router(model_list, search_tools)
            R-->>PC: Router instance
            Note over PC,R: ✅ Router created when models or search_tools present
        else Neither models nor search_tools
            Note over PC: ❌ Skip Router creation (Fix)
        end
    else llm_router already exists
        PC->>R: Update search_tools if provided
        PC->>PC: _delete_deployment(db_models)
        PC->>PC: _add_deployment(db_models)
    end
    
    PC-->>PS: Router updated/skipped
    PS-->>Client: Success